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ABSTRACT 

When Torgerson* s multidimensional scaling model is 
used in conjunction with the method of tetrads, derived coordinates 
are based on data which is assumed to be distributed normally* The 
object of this study was to determine the amount of error contained 
in derived coordinates when the normality assumption is violated* 
Torgerscm coordinates %*ere derived from various cases of ncnncrmally 
distributed data* Derived coordinates were then compared for accuracy 
to true coordinate values, which were known in each case. The 
Torgerson model produced highly accurate coordinates in all cases. 
Since a wide range of distributions was considered, the results 
appear to be quite genera lizable. (Author) 
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Introduction and Purpose 



Given neasures of dissimilarity between eadi pair of n objects 
Oj^,02,...,0j^, Torgerson's multidimensional scaling model determines: 
(a) tlie mmber of dimensions r needed to account for dissimilarities 
among the n objects and (b) the projecticMi of eadi object on each 
dimension. The dimensions obtained may be identified with properties 
of the objects vAdch account for input dissimilarities arong objects. 
Also, the recovered coordinates can be used to construct an 
r-dimensional representation or picture \itiidx shows the relations 
among the objects in a more visualizable form than that provided by 
the co!!5)lex set of dissimilarity neasures. For exanq^le, TorgerscMi 
(1958, pp. 280-290) used perceived dissimilarities among n « 9 objects 
to recover an r = 2 dL.i3nsional picture vSiicli Sfiowed quite clearly 
dissimilarities among the objects. The two dimensions corresponded to 
color brightness and color saturation of tlie objects. 

The method of tetrads (Torgerson, 1958, pp. 261-262) is a 
technique enqployed to obtain the dissiiailarity measures used as input 
to Torgerson* s multidiniensional scaling model. The netliod of tetrads 
assumes that perceived dissimilarity between a pair of objects is 
nomally distributed across a population of subjects. To the extent 
that tliis assumption is violated v/itli real data, error is introduced 
into resulting dissimilarity values (Subkoviak, in press). Tiiese 



erroneous input dissimilarities in turn affect the accuracy of the 
nunerical coordinates output by tlie Torgerson model. Finally, 
inaccurate coordinates lead to fallacious conclusions regarding the 
relationships anons the objects. Since nonnormal distributions of 
perceived differences between objects do ocair in practice (Jones 
§ Thurstone, 1955; ^tosier, 1941; Rambo, 1963), the purpose of the study 
was to determine the amount of error introduced into derived coordinates 
wiien the normality assimq)tion of the method of tetrads is violated. 

The Matlieraatical Model 
The Torgerson rultidinensional scaling nodel is a two stage 
procedure (Torgerson, 1958, pp. 247-280). In the first stage a 
unidimensional scaling netliod such as the netliod of tetrads is used to 
obtain the perceived dissiiJiilarity s^j, between eaci pair of objects 
(Oj ,0j^) . A constant is tlien added to convert each dissimilarity s 

Jk 

to a distance d^,^ between pair (0^.,0j,) Cfessick § Abelson, 1956). In 
the second stage, distances d^j^ are converted to a siatrix of scalar 
products h..^ between objects 0^ and Oj,, and the matrix is 'decomposed 
by factor analysis to obtain coordinates i^L^y^^i" " *^jT^ ^^^^ 
object (j = l,2,...,n). Violations of the noiraality assumption 
in the first stage introduces error into the coordinates generated 
in the second stage. The sequence of steps involved in the two stages 
is outlined belo',;. 
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First Stage 



(1) In the nethod of tetrads all possible pairs of object-pairs 
{(0, ,0.)^ (0-,0.)} are presented to a population of subjects who report 
idiich object-pair is more dissimilar. Symbol Pj^ represents the 
proportion of times (PyO^ is reported more dissimilar than 

^jk hi " ^ ' ^li jk proportion of times is rqported 

more dissrnilar than Pj^Oj^)* 

(2) Iten pair {(0^,0^^), OyOy)} is presented to a subject he 
perceives the dissimilarity beti^een 0^ and 0^ to have some magnitude 
Sj^j^; tlie perceived dissimilarity between 0. and 0^ has magnicude S^^. 
If Sjj^ - ^ subject reports pair to be more 
dissimilar than pair (Oj^,0-^); if Sjj^ - Sj^ < 0, he reports pair 
(Oj^,0^) to be more dissrnilar. Ties S^j^ - S^^-^ = 0 are not allowed. 

(3) The process in (2) gives rise to unseen distributions across 
the entire population of subjects: (a) a distribution of S^^ values 
wth mean s^^ for each pair (p. ,0j^) and (b) a distribution of Sjj, - Sj^-^ 
values with mean Sjj^ - s^^^ for each pair of object -pairs 

{(Oj^,0^), (Oj,Oj^)}. Furtheimore, reported proportions pj^-^ and 
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^jk hi ^^^^^ ^^^^ under the 

density function of S^^ - Sj^^. 

(4) The density of S^j^ - Sj^ is assumed to be noimal for each 
pair of object -pairs. 

(5) In the nost popular case, all S^j^ - Sj^ distributions are 
also assumed to have the sar.ie variance a = Var (S^y - Sj^^^). 

(6) L^der the assumptionr, of (4) and (5), the dissimilarity s., 
of pair is given by: 

'jk ^ |. ^hiJ]/f^(^-l)/2] (1) 



vrfiere ^^i jj^ is the noraal deviate at the Pj^^ percentile of the 
standardizerl normal distribution and pj^^ is the reported proportion 
associated with {(Oj^,0^), (0^,0^^)}. The summation in Equation 1 is 
across the n(n-l)/2 values xj^ corresponding to all {(Oj^,Op, (Oj,Oj^)} 
vhich involve (0 . ,0, ) . 

J K 

(7) Finally values s^^ given by Ecpjation 1 are used to compute a 
constant c v^ich is added to each s^j^ to obtain a distance d^^ ^jk ^ 
between 0^ and Oj^ G fessick P| Abelson, 1956). 

Second Stag;e 

(8) The distances djj^ obtained in (7) are used to compute an 
n X n matrix of scalar products h^^ between each pair (0^ ,0j^) 
(jjk = 1,2,*. .,n). 

(9) The scalar product matrix in (8) is decomposed by factor 
methods to obtain an n x r matrix of factor loadings. The j row 
of the factor loading matrix gives the desired coordinates 
(ajj,a^2>-»* of object Oy The accuracy of these coordinates is 
a function of the validity of the normality assumption in Step (4) 



^ of the first stage, 
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ilethod 

The procedure used in the study was as follows: 

(1) Coordinates were randomly specified for n » 8 hypothetical 
objects in r ^ 2 drnensional Euclidean space. The coordinates and tlieir 
locations in Euclidean space are shown in Figure 1. The object of the 
study was to determine the extent to iMch this known (true) configuration 
of coordinates could be recovered by Torgerson multidimensional scaling. 

(2) Tlie 8(8-l)/2 = 28 true Euclidean distances djj^ between pairs 
of coordinate points in (1) were confuted. 

(3> The (28) (28-l)/2 = 378 differences d.^ - dj^^ between pairs 
of distances in (2) were computed. These differences d^^ " " 

^^jk*'^^ ' ^^lii*^^ " ^jk " \i ^® °^ distributions 

^jk ' \i assumed to be normal by the method of tetrads. 

(4) A specific fom of density function was specified for each 
^jk ' \i distribution with the mean s^j. - s^^ computed in (3) . In 
some cases the 378 specified densities were nomal as assumed by the 
method of tetrads, and in other cases the densities were nonnoimal. 
Some of the nonnormal densities used in the study are compared to the 
assumed normal in Figures 2-5. All densities specified iiad the same 
variance = Var (S^j^ - Sj^^) = (115)^. Tlie rationale for choosing 
this value of a is indicated in (5) below. 

(5) Tlie density functions S^j^ - Sj^^ specified in (4) were 
integrated to the right and left of zero (0) to obtain .-oportions 
Phijk ^ Pjk,hi ^areas under tlie density curves) which are required 

to compute s^j^ in Equation 1. The choice of = Var (S.j^ - Sj^^) = 
2 

(115) avoided the occurrence of extreme proportions pj^^ = 1 or 0 
which result in normal deviates ^vy. jk ' t * ^ Equation 1. i'Jhen 
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such proportions arise in actual practice they are ignored, and s-. 
values are obtained in another way. 

(6) The proportions from (S) were used in conjunction 
with Equation 1 to obtain n(n-l)/2 dissimilarities s.^. Since the 
computational method assumes that all proportions pj^^ arise from 
normal Sjj^ - Sj^^ densities, error was introduced into s.^ values iMch 
is propagated in all subsequent computations to the coordinates derived 
by tlie model. 

(7) The Sjj^ values from (6) were used to comixite constant c 
Gfessick § Abelson) vMch was added to each s., value to obtain 
distances d^j^ = ^jk"*"^* ^® distances were converted to scalar products 
b^j^, and the matrix of scalar products was factored to obtain 
coordinates which contained error intorduced by tlie noimormal densities 
specified in (5). 

(8) Finally, the derived coordinates (aj]^,a^2) 0 " 1,2,... 8) 
from (7) were compared for accuracy to the known true coordinates of 
Figure 1. Accuracy was measured by correlating the 28 distances d., 
between derived coordinates with the corresponding true distances 
djj^ between coordinates in Figure 1. 

Results and Discussion 

Thirty-six different cases were considered by specifying different 
density functions in Step (4) of the Method Section. The densities 
varied in skewness and kurtosis and ranged in shape from normal to 
extrmely noraiomal . Coordinates (aj , a^ 2) ( j , 2 , . . . ,n) were 
derived in each of the thirty-six cases, and a correlation coefficient 
was computed as described in Step (8) of the Method Section. The 



obtained correlation^coefficients are shown in Table 1. Each coefticient 
in Table 1 is a measure of the accuracy of the coordinates derived 
for that case. In Cases 1-22 of Table l, .the 378 S^j^ - densities 
specified in Step (4) were identical in shape, although the shape 
differed in each case. In Cases 23-36 the 376 densities specified in 
Step (4) were not identical in shape, i.e. a variety of shapes was 
considered simultaneously. 

The primary result was that the Torgerson model produced highly 
accurate coordinates for all thirty-six cases. In no instance did 
the measure of correlation in Table 1 fall below .999. Considering 
the variety of densities employed in the study, it appears tliat the 
Torgerson model is quite robust with respect to violations of the 
nonnality assumption inherent to the method of tetrads. The following 
results of theoretical interest were also noted: (a) tne accuracy 
of coordinates tended to decre«\se slightly as densities departed frcm 
normality and (b) the accuracy of coordinates tended to be greater 
when densities were identical in shape as in Cases 1-22 than when 
densities varied in shape as in Cases 23-36. 

These results are consistent with other findings. Specifically, 
it has been demonstrated that Tliurstone's comparative judgment method, 
of vSiidi the method of tetrads is a derivative, produces reasonably 
accurate estimates -s^-^ as defined by Equation 1 regardless of the 
density functions from which proportions pj^^ arise (Subkoviak, 
in press). Thus, given reasonably accurate s^j^ values it is not 
sioTJrising that accurate coordinates result. Furthermore, increasing 
error is introduced into s.y. values as densities depart from assumed 
normality or become more heterogeneous in shape (Subkoviak, in press). 
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Thus, results (a) and (b) noted above can also be accotoited for. 

IMle it appears that tlie researcher need not be overly concerned 
about violations of the normality assumption in the Torgerson rrodel, 
certain limitations of the study should be bom in mind. First, only 
a single random arrangement of eight points in two dimensional space 
vas considered. Different configurations of points or different 
numbers of dimensions night produce other results. Second, the effect 
of extreme proportions such as P^i jj^ = 1 or 0 on resulting coordinates 
was not considered. Finally, all S^y. - Sj^^ densities considered had 
the same variance as assumed by the model. Violations of this 
assumption could result in less accurate coordinates than those derived 
in the present study. For further details regarding violation of this 
homogeneity of variance assumption consult ;«fosteller (1951). 
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Figure 1 

True Configuration of Eight Points in Two-Space 
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Figure 2 



I4onnomal Density 
Normal Density 
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Figure 3 

Nonnormal Density 
Normal Density 
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Figure 4 

Nonnormal Density 
Normal Density 
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Nonnomal Density 
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TAIiLE 1 

Correlation of True Distances d.. With Derived Distances d 
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